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ABSTRACT 

This study examined various misconceptions committed 
by junior high school students in fraction addition and subtraction 
problems. Almost 600 subjects were administered two tests, addition 
and subtraction, and their performances were analyzed by several 
computer programs, including two programs (FBUG and SPBUG) which are 
so flexible to any items generated by computer that they can be used 
for any teacher-made tests. A painstaking error analysis and 
construction of buggy programs were carried out and summary 
statistics are described. The analysis results indicate that 
individual differences in applying different strategies and 
procedural skills varied more among students than expected . Many 
erroneous rules were committed by students who used them 
sporadically. These rules are often observed only once per student 
and never used repeatedly by the same individuals. Various error 
types ( sources of misconceptions ) cover almost all the levels of 
tasks involved in solving fraction problems ., A close examination of 
frequency distributions of erroneous* rules revealed that some errors 
tend to appear among high-score students while others appeared only 
among low-score students . Systematic investigation of "bug-behaviors" 
will lead further understanding in human Cognition and learning and 
thus it will bring about further improvement in American education . 
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Introduction 

The purpose of this study is^ to examine various misconceptions 
committed by junior high students in fraction addition and subtraction 
problems. Almost 600 subjects were administered two tests, addition. and 
subtraction, and their performances were^ analyzed by several computer 
programs written by Robert Baillie and Doris Shaw. Especially FBUG and 
SPBUG (Baillie, are so flexible to any items generated by computer 

that they can be used for any teacher made tests.* SPBUG will provide 
descriptive statistics, response pattern analysis as well as error 
diagnosis. This program is also applicable to any fraction addition 
tests including teacher-made tests* 

* 

The rate of diagnosing erroneous rules (algorithms) of operation is 
as high as 90% of t *1 responses. Host rules are used with less than 
perfect consistency by many students, and sporadic deviations appeared 
in one or two items per student. Nevertheless, certain rules are 
observed in the same individual, where the student applies the rules 
systematically throughout the test. 

It in natural to assume that the erroneous rules resulting from the 
same type of misconception or incompleteness or lack of knowledge tend to 
be seen persistently in a variety of different types of items in a test. 
But as can be seen in Figure 3 in whicft the performances of students i 
th« test itejis are conveniently tabulated (S-P table, see Harnlscfe and 
Linn, 1981; Tatsuoka, 1978), some rules are seen over all items as well 
as for many students regardless of their scores. Other errors are 
observed more frequently in high-score rather than low-score students, 
while yet other rules are more common in low-score students. Some 
student performances — bug patterns— support "repair theory" (Brown & 
VanLehn, 1981), but many others exhibit more complicated bug patterns 
which are probably affected by complicated mental models based on past 
knowledge that the students have acquired. 

Methods for solving mixed fractions; Addition and Subtraction 
Method A. The mixed (or whole) number is converted to an 
improper fraction and then the strategy for adding (subtracting) two 



fractions is used. This method is especially noticed ln**subtraction ' 
problems where borrowing is needed* However, since this method involves 
manipulations with large numbers it is more subject to arithmetic 
errors. Reducing and converting the result to a mixed number is more > 

^frequently needed when this method is used than when other methods for 
solving mixed number operations are used. 

Method Bp The fraction part and the whole number part are dealt 
with separately. The advantage of this method is that once the whole 
number part is separated the student can manipulate 'smaller numbers as 
compared with the ones that would be manipulated t^ad Method A been * 
used. However, when using this method the student has to remember to 
repeat the operation twice: Once withjthe whole number end then with 
the fraction part. When the fraction part involves finding common- 
denominator equivalent fractions, and reducing and converting an 
improper fraction to a mixed number, the original whole number part can 
easily be 'forgotten. Moreover, JLn subtraction problems whejre borrowing 

* is needed it introduces an additional complication which does not exist 
when Method A is used. 
Examples: 

Method A Method B 

5 9/22 - 2 9/H 5 9/22 - 2. 9/11 

= 119/22 - 31/11 =5 9/22 - 2 18/22 

= 119/22 - 62/22 = 4 31/22 - 2 18/22 

= 57/22 - 2 13/22 - 2 13/22 



Rules for solving fraction addition and subtraction problem s, 

■b + e, 
l c " f ; 



b x e* 

' Adding or subtracting fractions O r - t) 



I. Like Denominators (c*f) * 

A, Add (or su* ract) numerators for*the numerator part of the result, 
(b+e) 

B. The denominator of the result is one of the two like denominators. 
(c t f),(c',f) 

II. Unlike Denominators (cjff ) 



A. Check if you can divide each fraction by a common factor. (See 

*.* 

flow chart, Klein, et al., 1981, ^g. 36.) 

B. Find a common denominator using one of the following methods. 

1. Prime Factoring Method 

2. Multiples. Method * 
. 3. * One of the denominators is a multiple of the other 

(For a flow chart of i-3, see Ibid, p. 33-35.) 
4. Automatic Method 

(Multiply the denominators together to get a common denominator 
b/c + e/f - bf/cf + ce/cf ) 

C. Find equivalent fractions (q^e chart Ibid, p. 37). 

D. Add (or subtract) the same as in step X. 

E. Reduce and/or convert iiaproper fraction to mixed number (for 
chart see Ibid, pp. 40-41) 

Adding or subtracting mixed numbers. 

Choose one of the following methods; 

Method A ; Convert the mixed number to. an improper fraction* Proceed with 

steps I. through II.E. (For a chart, see Ibid, p. 32) 

Meth od B; Add (or subtract) the whole numbers first then repeat steps 

I. through II.E. for the fraction part.' (In subtraction problems watch "for 

cases where b' < e'. You will have to borrow from the whole number 

part a, as in a — ) > 

c 

Figure 1 displays a flowchart for solving fraction addition and 
subtraction problems according to the above Mentioned rules. 

Insert Figure 1 about here 

i 

Class i f i cation of observed errors according to the task analysis . 

Based on the task analysis the observed errors can be classified 
according to tfhe following categories. The numbers or letters in the 
parentheses refer to the list of bugs in Table 1 for addition 
or subtraction. « 

mm ~ * — ■■ ■ ■ ~ i ■ ■ ■ m, 

Insert Table 1 about here 
I. Errors associated wit h a n incorrect use of Method At 

Classified into this category are errors resulting from applying 




til vide fraction 
bv comon factor 



convert ^Lnto 
proper fraction 



Figure 1: A Rough Sketch of a Flowchart Describing Different 

Methods for Sblvinp, Fraction Addition and Subtraction 
Problems 
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a ' Table 1 ( 

t 

Classification of Erroneous, Rules or Algorithms 
• According to the Task Analysis 



1. Incorrect Use of Method A 2, S, 7, 28,, 37, 40, 53 

< C, D, H • 



2, Incorrect Use of Method B 



32, ^J3, 39, 43 / 
A> Of £» F» G t J 



3. Incorrectly finding 12, 14\ 59, 62,> 64. 
common denominator c, d, h 

4. Inccorectly finding 10, 15, 17, 18, 19, 21 
equivalent fractions 23, 26, 60, 6*3, 66 

f f ' 

5. Faulty algorithms 11, 25, 39^46, 47, 48, 50 

51, 54, 55, 57, 58, 61, 65, 67 
a, b, g, n, x, y 

6 Simplification 

(reducing) lb, 6, 10, 11, 12 

(converting) la, 2, 3, 4, 5, 7, 8, 9 

The numerals and letters represent the rules (bugs or algorithms) innthe lis 
given in the appendix* 



Incorrect rules *of converting a. a$.xed" number to an improper fraction. 

Examples of these errors are multiplying the who^e number bj the * • 

numerator and adding the denominator (2); keeping the whole number part 

■ •■ ' " * * 

after conversion to an ; improper fraction has taken place (5); converting 

by multiplying the whole number by the numerator (7); converting by 

adding the whole number part to the numerator (28) (H); or converting the 

mixed fraction to a whole number by ignoring the denomina tor( 53) (D) . In * 

subtraction a mixed fraction is converted by adding all three' parts of ■>» 

the fraction, for the numerator (C); or in addition adding the three « 

mparts of the first fraction for the numerator of the result' and the 

three parts of the second fraction for the denominator (37), or .similarly 

adding the whole number and denominator of each fraction to obtain the 

numerator and denominator of the result (40). / 

2. Errors associated yich an Incorrect use of Method B . 

Classified into- this category are' errors resulting from applying „ 

incorrect rules* to the wnole number or- fraction parts such as operating 

only with the fraction part* and omitting the whole number part (33) (G); 

or operating with the whole number part and omitting the fraction part (J). 

Adding the numerator and denominator of the first fraction to obtain the. 

numerator of the result and similarly adding t the numerator and denominator 

of the second fraction to obtain the denominator of the result (39); multiplying 

the whole numbers *( 43) r or adding a one to the. whole number part (32) are noted 

In addition* Errors in borrowing are unique to subtraction problems. Among 

the incorrect rules that lead to borrowing errors are the following; 

>• 

when borrpwing reduce the whole number by 1 but add 10- to £he numerator (A); 

* «i 
borrow but forget to reduce the whole number from which it was J^orrowed (B);. 

when borrowing, add 1 to the whole number from which it was borrowed (E); 

and subtract I- from the numerator as well as from the whole number (F,). 

'* / 

3. Errors associated with findin g c ommon denominators* 
Classified into this category are errors resulting from applying 

incorrect rules for finding a common denominator such as choosing one of 
the two denominators as the common denominator , the first or second" 

Sir » 

denominator, the smaller or larger denominator ( 12, 62,64, c,d,h). 
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Several* errors are associated only with unequal denominators such as 

* * 

*4» gfrtojrs associated with finding equivalent fractions. 

'The following Incorrect rules result In errors classified into this 
category; the numerator of each equivalent fraction is the sum of the 0 
numerator and denominator of -that fraction (lO)j^wMle a*coumon 
denominator is found by multiplying the denominators or the LCD (least > 
common denominator) is found; .the numerators are added (J.5 ,17) or 
subtracted (f? or the denominators are added together (26). 

A fraction- that has 1 as its 'numerator is treated as if the entire 
fraction equals - 1 ' (18). The LCD is correctly found to be less than the 
denominators multiplied together, but then the numerators are cross 
multiplied *by. the original denominators (19); the common 'denominator Is • 
found but the original, denominators are used as the numerators of the 
equivalent fracion (21), or each numerator ip multiplied by its 
denominator (23)(60), or the numerator of the second fraction is added 
to its denominator (66) or the numerator is cross added to the other 
denominator (63) * 

5* Errors associated 'with the addition/subtraction a Igor it hps * 
The following errors result from applying incorrect rule's of operation 
adding or subtracting corresponding parts (41)(a): Converting mixed numbers 
to improper fractions and adding numerators' and denominators (67); inverting 
the second fraction and adding corresponding parts of the fraction (61); 
adding or subtracting only fraction parts that have different numbers 
in the. numerators (58)(g); multiplying corresponding parts of the 
fraction (48); o£adding whole numbers and numerators but multiplying 
denominators (54). . 

Another incorrect rule of operation is cross cancelling followed by 
multiplying numerators and adding denominators (47); subtracting' smaller 
from larger corresponding parts (x); adding numerators and denominators (46); 
or adding numerators arid multiplying denomlnators(57)^ r 

After finding a common denominator the smaller numerator is subtracted 
from the larger for an addition problem (50); or the numerators are 
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oultiplied (55). / » 

Other incorrect rules are subtracting the smaller' from the larger number * 
or adding both numbers In the first fraction to obtain the numerator and In 
the second one obtain the denominator (39) (y); adding numerators and 
subtracting denominators (65) or vise versa (b)< using the division 
algorithm(51)-(n).; Ignoring the numerator when the value is 10 (25). 
6. Errors associated with simplifying, the' result (reducing/converting) 
In reducing the fraction part .of a mixed number, omit the original 
•whole number part (lb) or divide all three parts,- whole number, numerator and 
denominator by the same divisor (6). In reducing a fraction where the 
numerator and, denominator are equal, the fraction part equals the value of, the 
numerator or denominator (10). In reducing the fraction part of an answer the 
numerator and denominator are divided by different numbers ,(12) or the 
numerator is divided by the greatest common divisor and the gcd becomes the 
denominator (11). ^. +* m 

In simplifying a mixed Improper fraction, convert the fraction part 
but omit the original whole number (la) or retain the original whole" 
number obtained from converting the Improper fraction par*" (2). 

In simplifying the improper fraction part of < the answer the new whole 
^ number becomes the numerator and any remainder is lost (3). In converting, the 
Improper fraction parr the original numerator becomes the new .'denominator (A).' 

Any conversion of an improper fraction-part will equal one (9)t This is 
an error only when the conversion does not equal one. In another cohveifslon 
error of an improper fraction the Wfeote nuihber \s the numerator minus any^ 
remainder after the denominator is divided into the numerator (8). " % 
A proper fraction has the smaller numerator divided into the larger 
denominator (7) but the denominator stays the same as the original unlike when 
the fraction part is inverted and then converted or reduced (5). 

The Test 

Twd lists/ one in addition and the other in subtraction, were carefullv 
designed in order to provide diagnostic Information. For a detailed 
description of the item construction see Klein, et al. , 1981. 

The addition test consisted" of -48 items and the .subtract Ion one 
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consisted of 42 items* Two parallel sets of items were included in each 

test, comprising the following 3 types of items F±F; F+M; M+F; M£M; 

tfjT; F+W; M+W; W+M (where M « mixed numbers, F - fractions and 

W - whole number). A preliminary analysis indicated that problems including 

a whole number were clustered on a different dimension than the other 

types of items. Hence, these items were separated from the rest * 

and will not be discussed in this report^ Thus/ we will refei? to two 

parallel sets of 19 items each in addition and two parallel sets of 16 

items each in subtraction. Figures 2 and 3 display thelites numbers • 

according tv their type* (The item numbers in the charge refer to the original 

Insert Figures 2 & 3 about here v * . 

numbers in the test. As can he seen in the charts f th» item^^ft each test 
included like and unlike fractions some of which could be simplified, 
i.e# f reduced and/or converted to a proper fraction, prior to the addition, 
subtraction operation* The subtraction chart also specifies the items that 
require borrowing -~ a procedure required where Method B is used* 
Datasets 

■ The tests described in the previous section were administered three 
times to junior high students. The first group was comprised of. 
148 8th and 9th graders who took the tests in the spring of 1982. The 

i 

second and third group obtained in the fall of 1982 were comprised of 
171 an<! 273 7th and 8th graders. The^ responses to the paper and pencil 
38- and 32,-1 tem tests s*ere typed on the PLATO system. The answers 
before reducing to the simplest form of fractions as well as those after 
reducing were coded separately so error analysis could be divided into 

c 

algorithmic and reducing parts. 

* % * 

Computer Program * 

* 

An algorithmic computer program for diagnosing erroneous rules used 
by students in fraction addition problems was written in FORTRAN on the 
PLATO system. . A similar program was developed on an Apple computer, but 
this version was not algorithmic and diagnosed errors by checking two 
numbers — one bring a student's response to an item and the other, the 
numbers (stored on^a disk) obtained by applying each erroneous rule to 
the item. j. • ' 
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8, 32 
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19, 43 








15, 39 
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Figure 2. fraction Addition Item Classification Chart (38 Items). 

S - Simplif iable (Item Before Operation) M - Mixed Number 

AS - Hon Simpllfiable (Item Before Operation) 



F - Fraction 



b e 

Note: a- + d-r . The numbers in the boxes are item numbers. 

c f 



FRir 



14 



c ■ f 
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< e 



r 



Mixed Fractions 
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4, 25 
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11, 32 
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c * f 



Simple Fractions 
(F - F) 



1 1 
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Figure 3. Fraction Subtraction Item Classification Chart (32 Items) 
S - Siraplifiable (Item Before .Tperation) M - Mixed Number 

IIS - Non Siraplifiable (Item Before Operation) F - Fraction 

Note: a~ - df . The numbers in the boxes are item numbers* 

c f 

* needs borrowing ' " 
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The program generates an S-P table by sorting the rows and columns 
of the original datamatrix by the orders of item difficulties and total 
scores* Then it calculates a correlation matrix, means and standard . 
deviations of items and students , caution index for each student and 
item. The second S-P table is obtained by replacing 1-0 scores by the 
number and letters designating seventy erroneous rules of operation in 
fraction addition and subtraction problems* An example of the second S~ 
P bug table is given in Figure 4» 



A nalysis results: What rules are frequently seen and what rules are 
observed together 

In the S-P bug table, missing data is replaced by 99, the use of 
i tie right rule is 1 and unidentified wrong rules or typographical, 
careless errors are marked by 0* The right-most column contains the 
total scores arranged in descending order from the top to the 
bottom. Later in this report, the three groups divided by the two lines 



shown in Figure 4* , which are drawn at the score of 29 ^nd 10 will be 
designated as high-, middle- and low-score groups and a summary of each 
groups' descriptive statistics and error analyses will be given and 
compared. 

* Insert Figure 5 about here 
As can be seen in Figure 5, the use of erroneous rule 11, adding 
the corresponding parts of t\*o fraction numbers, for the lower-score 
group is somewhat comparable to the use of the right rule In the high- 
score group* 

The order of item difficulties clearly reflects the difficulties 
predicted in task analysis. Table 2 gives the summary statistics of the 
dataset including the S-P bug table as a part shown lo Figure 4* jThe 
common factor in Item types VI, II, V f and I is that the items in these 



groups have equal denominators* The 16 items front the right-most column 
have unequal denominators ■ Figure 4 clearly shows that students In the 
middle group don't know how to obtain the largest consnon denominator of 



Insert Figure 4 about here 



Insert Table 2 about here 
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Figure 4: S-P Bug Table: The Data Matrix Filled by Student Bugs. 
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Table 2 

Item Difficulties, Values of the Caution Index 
and Item Types of 38 Fra&llon Addition Problems 
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the two numbers, while the students in the low-score group don't know 

j * * 
.how to add two tractions* The numbers shown in Figure 3 represent 

erroneous rules* 

The caution Index (C^) shows that the lteas in the fraction 'A 
addition test were reasonably well constructed because the values of *C£ 
are all nearly zero. 

Table 3 shows the percentages of descriptive statistics obtained by 
error analyses per foroexi on the three datasets. The average' percentage 
of Identified rules by "S-P bug" is 90.8% including the right rule, 
76.12 excluding the right rule. This rate of error diagnosis is * 
satisfactorily high* 

Insert Table 3 about here 
The use of erroneous rules of operation varies among individuals* 
As can be seed in Figure 4» the most popular rule is (fortunately I) the 
righjt rule and the secorid most popular is Rule 11* The 48 different 
rules in fraction addition were observed and the percentages of their 
frequencies of use by 592 students were 'summarized in Table 4* The next 

Insert Table 4 about here 
rule to Rule w 11 in use-frequency is Rule 67. Then Rules 14 , 12 • 7 and 17. 
Rule 12 is associated with the task of finding the least common 
denominator (.LCD). Rules 15 and 17 originate from finding equivalent 
fractions; first the § common denominator is obtained by* multiplying the 
denominators or finding the LCD and thekj^the original numerators are added 
without being multiplied by the appropriate number. -"Rules H and 67 

a 

result from misconceptions in adding two fraction numbers. Rule 11 is the 
addition of corresponding parts of two numbers while Rule 67 applies the 
same rule as 11 after converting mixed number to improper fractions. Rule 
7 occurs when mixed numbers are converted into improper fractions; new 
numerators are obtained by multiplying whole number parts by numerators 9 
not denominators. Then the right procedure is used to get the final 
answer. . • 

Rules 60 aid 41 are observed only once each in 592 students. Rule 
60 is "the numerator times the denominator of the 4 first fraction plus 

0 



Table "3 

Percentages if Various Descriptive Statistics of 

Tliree Uatasets * 



# • 
Correct 

Incorrect 

/Missing 

♦ 

Identified with 
Correct Rule 

Identified 
without Correct 
Rule 



Dataset I 



Dataset II. 



Dataset III 



48.63 ' 
43.39 
5.92 

69.51 . rt 
" i 
78.26 



% /^.67 
31.78 



3.55 



92.18 



76.27 

r 



57.89 
33.59 
8.51 

90.62 
„ 74.46 



Total 
N-592 



57.55 
36.02 - 
6.43 

90.81 
76.12 
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Table 4 

» 

Frequencies of the Use of Erroneous Rules of Operation 
in 38 Fraction Addition Problems 
Ci-592) 
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40 


7 


54 


73 


67 


258 





27 



the numerator times the denominator of the second fraction to obtain the 
numerator of the answer. Multiplying the two denominators to get the 
denominator of „ the answer* M Rule 23 is a rule similar to Rule 60, but * 
20 cases are observed in the data. Rule 23 is the multiplication of the 

9 

numerator and denominator to get *the new numerator, and the denominator 
is the common denominator. The right addition procedure follows in both 
the rules. Since Rule 41 is an odd rule, the description will be 
omitted here. * 

According ta the classif ication of erroneous rules based on task 
analyses, Rule 7 belongs to Category 1, Rule IS to Category 4, Rule 12 
is in Category 3, and Rules 11 and 67 belong to Category 5. 

Next/ further investigation of the difference betv in ther 
performances of high and low score groups on the fraction addition test 
is summarized in Table' 5 below.- The distributions of 'the frequencies in 
the two groups are quite different. The high-scote group has more 

Tnsert Table 5 about here 
students that used Rules 33, 32, 21, 18, 43 than the low-score group 
lias. These rules are classified in C£ and C4 which are designated by 
"incorrect use of Method B ,f , and "incorrectly* finding equivalent 
fractions." Especially Rule 33 occurs by omitting the whole number part 
in the ^nswer. Conversation with teachers in a class confirmed that Rule 
33 is due to a careless mistake. Rule 32 is associated with the 
principle that any number plus zero is that number. The outcome of this 
rule is that when adding mixed numbers, students add a one to the whole 
number part of the answer. It is interesting to note that the 
principle, a + 0 ■ a for any number a, may be a difficult concept to - 
understand for a junior-high aged 'student. The third rule strongly 
differentiates good students from poor students* This rule* uses the 
denominators of the original fractions as the numerators of the new 
fractions while the right LCD is fpund and the right addition procedure 
is used to get the answer* 

The students in the low-score group tend to use Rules IS* 48 and 54 
sporadically and Rules 11, 67, 10, 45, 26 and 37 systematically. It..is_. 
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Table 5 

Frequencies of Erroneous Rules Observed in the 38-*ttem Fraction 
Addition Test by High Score (Z 29) and Low Score (£.9) Groups 
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interesting La look at why the former appear sporadically throughout 
a test and the latter systematically. Rules 15 (described earlier), 
4a and 54 are classified in C$, faulty algorithms for addition 
procedure. Rules 11, 67 and 45 belong to C5 but these bugs are usually 
applied systematically. Rules 10 and 26 belong to C4, incorrectly 
finding equivalent fractions. 

Probability of Fug Occurrences as a Function of the Total-Score Scale 
In the previous section, we have found an Interesting difference 

In the frequencies of certain bugs between high-score and low-score 

students. Further investigation of bug-distribution is carried out % 

in this section. 

The formula used to produce probability distribution of bug y 

given score x is presented below. 

Frequency of bug y among students who score r. 



P(y,x) - 



£(# of students who scored x) + l] * (3S-r.) 
37 

"j. Frequency of, bug y among students who scored x 
1-1 [(# of ^students who scored K.) + i] • (38-x,) 



This will provide information about the relationship between 
total score and appearance of bugs. If total score does not relate 
with the occurance of bugs, the probability of bug y given scfcre x 
would be uniform over x and its value would be 1/37 - .02703. 
Thio would imply that a bug y is equally likely to be committed by 
students who answer any number of items correctly. On the contrary, if 
P(y,x)j systematically deviates from the uniform probability 
distribution, that indicates trie existence of a particular 
relationship between the incidence of a bug and total score. For 
example^ in Figure 6, bugs 32, 33, 43 are seen to be more likely 
to be found among students who score above 25 than among students who 
score lower than 25. These three bugs are classified together in 
Table 1 (as being an "incorrect use of Method B M group. Since 
there wejre only four accurances of bug 39 \ its probability distribution 
was not calculated. A negatively skewed probability distribution 
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23 



(indicating greater probability of occurrence among students with 
high score) was not found in any other bugsbut these three. It 

can be said that. Method B is attempted only by. students who '\ 

score high. Figure 7 shows the probability distributions of three 

- - " * 

Insert Figures 6, 7 & 8 about here 

bugs that are more likely to be found among students whose total 

score is low. These bugs indicate lack of understanding of the 

meanings of numerator and denominator. For example, a student 

with bug 37 adds all numbers in the first fraction to obtain the 

numerator of the answer and does the same on the second fraction 

to obtain the denominator, la Figure 8, the probability distributions r 

of bugs IS and 17 are presented and they show that these bugs are 

most likely committed by students whose scores are in mid range. Both 

are bugs associated with faulty methods to find the denominator 

of v the answer. These unique bug probability distributions may provide 

the reason why bug migration occurs and why the direction may be 

more orderly than one might expect. For. example, one student may 

exhibit bugs 37, 17 and 33 consecutively, as he/she progresses in 

learning, but not. in*fcke reverse order. It should be noted that only 

bugs which' showed narrow concentrations of probability are presented 

in three figures. Most of the bugs did not show any semblance cf a 

uniform distribution over total score. 

Analysis of Results: Stability of the Use of a Rule 

Both the test for addition and that for subtraction of fraction 
arithmetic are constructed so as to contain pairs of parallel items. 
If a student uses his/her own rule consistently, then the answer of 
the two parallel items, should match the responses generated by the rule. 

In order to tSkt the stability of a bug, the frequencies of two 
pairs, (1,0) and (0,1)— a students' use of the bug for solving the 
first item but not for the counterpart of the first item, and the 
second binary pa'ir (0,l)stands for that the second item was solved by 
application of the bug but not the first item — were' counted and then 
McNemar's test was carried put. Table 6 contains the frequencies 
and the results of a significance test with respect to the righx rule. rrr 
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Probability 




Figure 8 : Probabilities of bug occurrences of 11 and 15 



Probability 



0. 1 



0.0 




MM 1 I I U f H | Total score 
25 30 35 



Figure 6 : Probabilities of bug occurrences of 32, 33 and A3 



probability 



0.4 - 



0.3 



0.2 



0.1 - 



0.0 




i i » 1 1 1 i m \ i n-rr T i i i i i Ht f i i iW-rM«¥-rrt\ i Total score 



V 



0 5 10 1$ 20 25 30 35 

Figure 7 : Probabilities of bug occurrences of 37, 45 and 67 

33 



9 

ERIC 



■ * 



. i..' 



26 



ERIC 



Significantly different pairs of parallel items are listed 
in Table 7 in terms of the use of various erroneous rules of 



Insert Tables 6 & 7 about here 



operation. Six pairs of parallel items have the z values of 
p y 0.001 in Table 6, Table 7 shows quite a>few bugs are applied 
inconsistently to the two parallel items. But, we have actually 
tested 284 pairs for McNemar f s test and 31 pairs turned out to be 
significantly different as can be seen in Table 7* This means that 
most erroneous rules are used consistently for two parallel items. 
However, it should be noted that 6 out of 19 pairs in Table 6 
shoved significant differences In the stability of the use of the 
right rule. Indeed, all the items in 19 pairs are not necessarily 
parallel in terms of procedural steps for carrying out all the right 
rules which were described in the earlier part of the reports m More 
strict, accurate definitions of parallel items referring to each 
procedural step may be needed. 
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Table 6 

McNfemar's Test for Two Parallel Items in Fraction Addition 



When the Right Rule was Used 



Items 


<01) 1 


(1,P) 2 




1 93 


68 


76 


-.670 


9 9A 
L f LO 


24 

LH 


143 


-9,29* 


1 97 
J t Li 


(%Q 

WW 


48 


1.15 


A 9 ft 


J D 


45 


-lJl2 


C *}Q 




57 


.19 

• * ✓ 




17 




-3.98 




JO 


44 


-.66 


ft 12 


23 * 


33 


-1.34 


9, 33 


61 


65 


^-.36 


10, 34 


22 


35 


-1.72 


11, 35 


26 


46 . 


-2.36 


12, 36 


46 


49 


-.31 


13, 37 


34 


64 


-3.03* 


14, 38 


26 


54 


-3.13* 


15, 39 


20 


34 


-1.91 


16, 40 


31 


* 57 


-2.77* 


17, 41 


23 


45 


-2.67* 


18, 42 


50 


54 


-.39 


19, 43, 


31 


51 


-2.21 



*p c 0.001 

1 The second item in a pair was answered by the right rule 

2 The first item in a pair was answere by the right rule 
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Table 7 

McNemar's Test for Two Parallel Items In Fraction Addition 

When Bugs were Used 



Item 


Bug 


(0.1) ^ 


(1.0) 


(1.1) 


. z 


1, 25 


5 


0 


11 


0 


-3.32 


2, 26 


15 


0 


23 


7 


-4.80 


,3, 27 


11 


17 


55 


91 


-4.48 


4, 28 


54 


1 


17 


2 


-3.77 


5, 29 


7 


1 


48 


0 


-6.71 


10 


0 


21 


1 


-4.58 




11 


47 


0 


68 


6.86 




33 


36 


0 


0 


6.00 




67 


17 


6 


7 


2.29 


6. 30 


11 


36 


15 


57 


* 2.94 


7/31 


11 


. 16 


51 


94 


-4.28 


8, 32 


12 


3 


14 


0 


-2.67 


- 


15 


9 


26 


15 


-2.87 


9, 33 


5 


0 . 


7 


. 0 


-2.65 


10, 34 


HONE 










11, 35 


10 


9 


0 


0 


3.00 




15 


4 


23 


5 


-3.66 


M 


21 


2 


13 


0 


-2.84 


12, 36 


11 


12 


28 


59 


-2.53 


13Y 37 


17 


4 . 


13 


•! 4 


-2.18 




47 


0 


. 10 


0 


-3.16 




54 


6 


0 


0 . 


2.45 


14, 38 


11 


19 


35 


52 


-2.18 


15, 39 


15 " 


2 , 


15 


4 


-3.15 


16, 40 


7 


0 


' 19 


1 


-4.36 




10 


0 


15 • 


1 


.-3.87 




11 


11 


0 ' 


61 


3.32 




54 


5 \ 


0- 


0 


2.24 


17, 41 


NONE 










18, 42 


17 


2 ^ 




, 5 


-3.00 




59 


11 




0 


3.32 




64 


0 




• 2 


-5.48 


19, 43 


11 


14 


34\ 


93 


-2.89 



\ 
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Simplification Errors 
Scoring •Procedures' / 

Quite ^ftumber of students did not reduce their final answer to the 
simplest form. Thus, two scoring methods are used in scoring the test 
items.. Since the 36-itom test is open ended, each response is viewed as 
being comprised of three components; the whole number, the numerator and 
the denominator. With scoring Method 1 student responses are scored 1 * 
only If all the components equaled the corresponding components of the 
correct answer. 

With scoring Method 2, the student responses were converted into a 
decimal number first* and then they are scored 1 only If the converted 
decimal number matches the decimal number of the correct answer. By so 
scoring, the students' answer will be scored correct f regardless of whether 
or not the answer is reduced to the largest simple form, or converted to a 
mixed number. As long as the responses are carried out correctly up to 
the addition or subtraction of equivalent fractions, such responses are 
credited as correct answers. 

< The following figure, Figure 9 shows the relationship between scoring 
"Methods 1 and 2* The X-axis stands for the proportion correct for Method 



Insert Figure 9 about here 
1 while the Y-axis represents the p- values obtained by scoring Method 2. 
Since Method 1 produced fewer scores of 1 than Method 2, most points in 
Figure 1 are located above 0 the 45-degree line and only a few students' 
scores do not change by either method, primarily those having high ^gcores. 
Analysis of Simplification Errors; Addition Data 

We are looking at simplification errors between the nonsimpllf led (NS) 
and simplified (S) answer regardless of the correctness in v$lue 
> of either answer. 

1 For each problem on a student's paper two answers are recorded , 

**. 

a nonslmpli fled answer and a simplified or final answer. When only 
one answer appears on the paper it is repeated for the NS and S answer. 
■ One answer may mean that no work la shown to indicate a method used or s 
that after a student reached an answer they, left It In whatever 

» 
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form and made no attempt to convert or reduce. In the following tables 
Ur2 will stand for addition data Collected at Urbana Junior High School 
(UJHS) in the fall of 1982. Url will stand for data collected at UJHS 
in- the spring of 1982 and Su2 will stand for data collected at Sullivan 
Junior High School in the fall of 1982. 
One Answer Problems i 



f Students 
in group (n) 
Ur2 171 

tin us 

Su2 273 



Repeat Answers over 
Total problems (nx48) 

v v asm;. 

8208 m 



4108 
TI04 

6969 
13104" 



S8Z 



53% 



Some of the above answers with one answer repeated in the NS and S are 
blanks. Either the problem was not attempted or an answer was not 
reached. • * 

. Problems for 

t 

Students 'with Blanks 





X Students 


, X Total 




• & 


Problems 


Ur2 


J* m 28Z 
171 


333 
8208 * 


Url 


iH - « 


502 
7104 ' 


Su2 




1313 
13104 " 



4% 



7Z 



10Z 



333 . 



2304 

502 
3072 

1313 
6144 



- 16Z 



- 21% 



It could be considered a simplification .error if the answer was not 



in a simplified or reduced ■ form* —~ f 



48 ,18 



and 8 are all acceptable 



answers for problem one because they are numerically equal and correct. Since 

* ' > '* 

we don t* agree on one final simplified form, we only look at the problems 

■ ' 

where the student attempted some form of simplification. Many students 
had changes between the NS and S answer. >* 
Answers with changes between N S and S 

T • - 

Url 



4194 
8208 



'51% 



39 



Url 



Su2 



2996 
7104 

"6135 



• 42Z 



47% 



* i 

In looking at answers where there are changes between NS and S we are 
Interested In the ones where the two answers are not numerically equal. 
Number of Problems Numerically Unequal 
NS S « 

,iJL * 1 J ' "- M1J - J 1 " ' ' ' ' " 1 ft 

c incorrect incorrect «r— * 
d correct incorrect 
e incorrect correct 



Ur2 



Su2 



Ur2 


Url 


Su2 


293 


470 


331 


291 


2,77 


374 


79 


113 


148 


663 


860 


853 



Totals 



Number of Students wltfr Numerically Unequal Answers 



Ur2 * 


Url . 


Su2 


■» «.• 


, 134 


140 


216 




" 129 


134 


205 





c,d,e 
c,d 

Errors between the NS and S answer (NS f S) 



Z of students 



number of + answers over 
problems with changes 



134 
171 



Url HO 
148 

216 



273 



78Z 



- 95Z 



- 79Z 



663 
4194 

860 
2996 

853 
6135 



- 16Z 



- 29Z 



- 14% 



1 .of Problems with Changes between NS and S 
. that Fit the Following Three Items 



e 



Ur2 

293 
4194"" 1% 

291 
4194 

79 
4194 



Url 



Su2 



7% 



2Z 



470 
299o" 

277 
2996 

113 
2996 



16Z 
9% 

4Z 



331 
6135 

374 
6735 

148 
6135" 



5Z 
6% 

21 



40 



33 



The errors in e seea to be caused by Che student dealing with, the 
fractions first and adding on the whole number- part foif the final answer. 

Although the student was unaware that we were interested In the 

#■ 

nonsimplif led answer it shows sloppy work on the part of the student and 
an erroneous concept of an equality* ' 

19 18 '18 i 

jg" does not equal 7— although the, latter is a correct answer . 
to the problem number forty eight. 

We turn our analysis to the problems with changes that have 
a numerically incorrect answer in the final form. 

Eleven erroneous' rules were used to identify simplification errors. 
These rules are not totally exclusive, one problem may appear in more 
than one rule type. 



Rl : In simplifying a mixed number the original whole number is omitted 
2 *2 



ex: 4-^- ~ 2rr j 



*9 3 ' ' 

The student deals only with converting and/or ' reducing the fractipn 

part and shows an erroneous concept of an equality. t 



Students 



Problem 



Ur2 Url Su2 

15% 



8% 



27 


32 
134 " 


24% 


31 
205 


39 « ,„ 
584 - 1% 


64 
"747 " 


9% 


57 
705 



R2 : In simplif yin^an answer with an improper fraction part the 
original whole number is recorded and the new whole number from the 
improper fraction part is omitted. " 

Ur2 Url Su? 

Students 22 17 „ 20 A_ 32 



129 134 . 205 

Problem/ 36 , v 21 „ 40 

584 " 61 747 " 32 705 " 6% 

Answers 



41 



* 

34 

Some of the problen answers could be examples , of Rl or R2. In 

problem number five the answer could be 

27 13 1 
14 14 . 

The original whole number and the new whole number from simplifying 
the fraction are the same number, In this case a one. In problem nine the 
repeated number Is a 2* 
ex: 2ii.2f 

If there are not other clear examples In the students paper, a 
discussion with the individual student might reveal which simplification 
error was in use. 

R3: In simplifying the improper fraction part of the answer, the new 

whole number becomes the numerator, ignoring any remainder, with the same 

denominator. The original whole number part, if any, remains unchanged. 

e 18 c 3 e l 
ex: *T ^ " *2 

14-2 

5 5 

Ur2 Url Su2 

Students 15 „- 14 1rt _ 28 ... 

129 " 92 134 * 102 205 " 142 

Problem/ 23 _ ^ 20 _ ^ 49 m ^ 



Answers 



584 747 705 



There are a few examples where an answer could be Rl , R2, or R3. 
ex: 2^ - 2j 

The problem leads to an answer involving three 2's, the original 
whole number, the new whole number from the conversion of the fraction and 
the new numerator. In this case the nonslmplif led answer is correct but 
the simplified answer is incorrect. 

R4 ? In simplifying an improper fraction divide the denominator 

by tie numerator as usual but use the numerator as the new denominator. 

7 .2 
ex: y - ly 

R4 seems to be exclusive in occurence with the problem answers not 

appearing in more than one bug. / 

Ur2 Su2 

Students Vll 4 • 18* A „ 

129 " 92 T34 " 32 205 ' 92 
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Problem/ JL8 „ 32 -1*1* - 32 

Answers- »♦ * 747 " 705 " 

R5 : la simplifying a fraction the fraction is first inverted and 

then usually reduced. 

10 . 5 1 
ex ' 5 10 2 

^6 *18 ^ 
This like R4 seems to be exclusive in occurrence. 

Ur2 Url , Su2 

Students 15 20 34 

. T29 " iZ * T34, " l ** 205 * i '* 

Problem/ 27 _ 51 65 „ 

584 " 5 * 747 " 75 705 " V * 

Answers 



R6 : In simplifying a mixed number, all parts are divided by the 

same number. 

ex: 2-77- ™ l-=r 
14 7 

Ur2 Url, Su2 

Students I 4 9 

129 15 134 JA 205 w 

Problem/ 2 _ " oir 8 _ _14 „ \ 



Answers 



584 ~ ,3Z 747 " 11 705 " 11 



V 



c (NS jj S) ; Both answers for this problem are incorrect and 

numerically unequal. 

g 4 A 
ex: 5 — m 5~ 

5y^- is the wrong answer for problem number thirteen and then 

the reduction to 5 1/2 is incorrect. 

b (Blanks for NS and S) : No answer attempted or reached 

ex: NS - 99|i 
99 

S - 99|| 

a (Letter to letter correspondence between the NS and S answer 
including the blank answers of b. ) 
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ex: NS 



.18 



S 



.18 



R7 ; The smaller numerator divided into the larger denominator but 

the. denominator stays the same in the final answer. 

30 



ex: 



35 



1-1 
A 35 



Students 



25 
70 
Ur2 

2 

129 



20 

ii — ■ 

70 



on 



2% 



6 

134 



4Z 



Su2 
6 



205 



- 4X 



3 

584 



.52 



14 
747 



2Z 



10 
705 



Problem/ 
Answers 

R8 : In simplifying an improper fraction, the new whole number is the 
numerator minus any remainder after the denominator is divided into the 

numerator. The fraction part is handled normally. 

PY . 54 ao_A 
ex * 12 *12 



Students 



14 ^14 



Ur2 



Url 



129 



- 3Z 



3 

134 



2% 



Su2 



205 



3« 



Problem/ 
Answers 



584 



.7* 



747 



- ,4Z 



7 

705 



1% 



R9 : Any conversion of an improper fraction is a one. 



A6 
ex: Trj 



10 
5 



Students 



2ii- 3i 

*T 5 



Ur2 
30 . 



on 

17 



129 ~ 232 134 " 13% 



Su2 

32 m 
205 " 



16% 



9 
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Problem/ « _40 _~ _23 _38 ** 

Answers 584 747 705 " 

This 9 of course, is not counted if the conversion should be one. 

RIO : In simplifying a fraction where the numerator and denominator 

are equal the resulting whole number is the value of the numerator but not 

a one. * <: 

ex: | - 4 • ) 

ViZ ' Uri. Su2 

Students 2 9¥ 0 •* • 1_ 

129 205 °* 

Problem/ 2 m 0 J± m w " 

584 705 a 

Answers 

Rll ; In reducing a fraction the gcd (greatest common denominator) is 
found and divided into the numerator as usual but the gcd becomes the 
denominator. 

15 5 

Ur2 JJrt_ Su2 

Students 13 in - 16 ... 10 _ 

T29 " 102 134 " 122 205 " 51 

Problem/ 17 _ 19 16 ? , 

584 32 747 32 705 22 

Answers 

d (NS >t s ); The NS answer was correct but the S was incorrect. The 

two answers are numerically unequal* 
ex . 26 m 13 

26 36 16 j3 

■~ iss a correct answer to problem number thirty eight but — 
36 ,« lb 

is an incorrect reduction of that answer. It should be — . 

e (NS j* S) The NS and S answers are numerically unequal but the S 

answer is correct in numerical terms. 

ex: if- - 7-i ■ 
18 18 

The above example is a correct answer for problem number 48. 

18 Q 

ex: — r » 8 

P m 



o 
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This is a correct answer for problem 1 but is not. 



fx In either NS or S the fraction has a zero in the denominator 
of the fraction* 




Analysis of Simplification Errors: Subtraction Data 




We are looking at simplification errors between the aonsimplif led 
(NS) and simplified (S) answer regardless of the correctness in numerical 
terms of eithei answer* - 

In looking at the subtraction fraction problems the problems lead to 
fever necessities for simplification in the answer than with the addition 
problems* The number of one answer problems therefore is greater* Within 
this smaller group of problems with answers that show, a change between the 
NS and S and are numerically unequal, we see many of the same errors 
appearing at the same rate in relation to the smaller sample of changes. 

For example with the Urbana addition data taken in the Fall of 82, 
51Z of the problems had changes between the NS and S answer. Some form of 
simplification was attempted* But with the Urbana subtraction data taken 
at the same time only 19% of the problems had any changes* This seems 
reasonable when we look at the difference between addition and subtraction 
and the particular problems involved in each test* 

One Answer Problems 

# Students Repeat Answers over 

in group (n) Total problems (nx48) 



Ur2 



167 




Su2 



Z3Q 




Url 



139 



4809 
5838 



« 82% 



46 



Blank Answers 
Z students 



Ur2 



Su2 



Url 



49 

\tr. m 29 * 



94 
230 

81 
139 



41% 



58% 



I total 

problems 

Sit- 82 

1223 



% problems for 
students with blanks 



9660 

600 
5838 



13Z 



10Z 



531 
I058 

1223 
3948 

600 
3402< 



- 262 



31Z 



- 18Z 



Answers with Changes Between NS and SI 
Ur2 1330 



Su2 



Url 



7014 

2044 
9660 

1029 
5838 



- 19Z 

- 21Z 

- 18Z 



Number of Students with Numerically Unequal Answers 







Ur2 


Su2 


Url 


IICZ 


c,d,e,f 


85 


105 




II 


c,d 


77 


93 


70 




Number of 


Problems 


with Numerically Unequal Answers 






UrZ 


Su2 


Url 


II 


c 


149 


128 


i49 


CI 


d 


60 


68 


'9 






(209) 


(196) 


(218) 


IC 


e 


" 40 


27 


23 


ZE 


f 


78 


27 


23 






327 


292 


260 Totals 




Numerically Unequal 


Answer 


Betwe^i NS and S 



Students 



Ur2 



Su2 



Url 



85 
167 

105 
230 

31 
140 



51% 



46Z 



58% 



Number of Answers over 
problems with changes , 

-22. - 25Z 
1330 ^ 



292 
2044 

260 
1040 



14% 



25? 



* 



47 



40 



Percent of Problems with Changes Between NS and S that Fit the 
Following Three Patterns 

Ur2 Su2 Url 



MS answer-Si answer 
incorrect / incorrect 

correct incorrect 

incorrect i* correct 

zero denominator in 
NS or S answer 



149 - 111 
1330 

60 - 52 



1330 

40 - 3% 
1330 

78 - 6% 



128 - 62 149 - 14% 
1029 

69 - 72 



2044 

68 - 32 

2044 

27 - 12 

2044 

69-32 



1330 



2044 



1029 

23 * 22 
1029 

19 - 22 

1029 



* 



Summary of Simplification Errors Found In Subtraction Data 





Ur2 




Ur2 


Su2 




Su2 




Url 


Url 




Students 


Problems 


Students 1 


Problems 


Students 


Problems 


Rl 


10 - 

77 


132 


15 - 72 

209 


4 - 

93 


42 


6 - 

196 


32 


"10 - 
70 


142 


19 - 92 

218 


R2 


3 - 

77 


42 


6-32 

209 


5 - 
93 


52 


196 


32 


9 - 

70 


132 


11 - 52 

218 


R3 


4 - 

77 


52 


9 - 42 

209 - 


1 - 

93 


12 


1 - 

196 


.52 


8 - 

70 


112 


9-42 
218 


R4 


5 - 

77 


6% 


5-22 
209 


11 - 

93 


122 


11 - 

196 


62 


3 - 

70 


42 


4-22 

218 


R5 


6 - 

77 


82 


10 - 52 

209 


9 - 

93 


102 


14 - 

196 


72 


6- m 
70 


92 


10 - 52 
218 


R6 


4 - 

77 


52 


4-22 
209 


2 - 

93 


22 


2 - 

196 


12 


1 - 

70 


12 


1 - .52 

218 


R7 


5 - 

77 


62 

- • 


6-32 

209 


2-22 
93 


2 - 

196 


*12 


1 - 

70 


12 


1 - .5 

218 


R8 


1 - 12 

77 r ' 


1 - .52 

20? 


1 - 

91 


12 


3 - 

19S 


22 


1 - 

7tf 


12 


1 - .52 

218" 
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R9 

RIO 

Rll 



7.-92 

77 



2 
77 

2 

77 



32 



42 



9-42 
209 

3-12 

209 

2-12 
209 



4-42 
93 



4-42 

93 



4-22 

196 



8 

70 



112 



4 

196 



22 3 
70 



42 
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Fraction Subtraction E rrors t Case Studies 
A 42-1 tea test of fraction subtraction problems designed to diagnose 
erroneous rules as projected in Klein, et al., (1981) was given to 139 
junior high school students. The free response test allowed examination 
of the sudent's wrong answers by several net hods of error analysis. The 
paper and pencil test was scored by teachers- and manners of the research 
group. The student responses were then entered into both the PLATO 
computer at the University of Illinois and a set of analysis programs 
Implemented in Pascal on the Apple 11+ computer. A, description of these , 
micro-computer programs is presented in another section. Thirty-two of 
the test items, those not involving whole numbers as either the minuend 
or the subtrahend, were used for the micro-computer sudy. Various 
calculations! procedures as well as searching techniques were used to 
select cases which illustrate th<? error patterns and interpretations, as 
well as the pfoblem-solying methods used by the. students. 

The continuing theme that is illustrated in these studies is- that 
obtaining high scores on a tesc of mathematics problems does not indicate 

that the student has developed a high degree of understanding of 
mathematical concepts. A student who uses erroneous rules may reveal 
knowledge that another student who earns a higher score does not 
demonstrate. Such Information may be obtained from examination of 
methods of problem-solving and from evidence of the perception level 
necessary to arrive at certain error patterns. The explanation of these 
relationships will be discussed as the case studies are presented. 
The Meaning of Fractions 

Case 1. Some students do not recognize the fraction as an specific 
quantity. A few try to ignore the fraction part in a mixed fraction. Bea 
writes that: 

4 4/12 - 2 7/12 - 2 and 3 3/8 - 2 5/6 - 1 
She used this rule for 15 items, all mixed fractions. Her misconception 
concerning the meaning of a fraction was also reflected in her incorrect 
procedure for subtracting simple fractions. She added the denominators 
and subtracted the numerators: 
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5/3 - 3/4 - 2/7 and 6/7 - 4/7 - 2/14 - 1/7 

The concept that the written form of a fraction represents a 

particular quantity require* that the student be able to visualize the 

partitioning of a unit into any number of equal parts. The unit may be 

expressed as 5/5, 10/10, or 127/127. The denominator indicates the 

number of parts that the unit is to be divided into and the numerator 

represents the number of those parts the quantity includes. The student ^ 

might say in interpretation of "2/3", "If a unit (one) were divided into 

three parts, this amount is two of those parts*.*. Erroneous rules often 

arise when the sudent thinks of the fraction as a "2" and a "3" , each to 

be treated individually according to some procedure. Many of these 

wrong rules result in wrong answers; however, occasionally they result 

Itf correct answers for certain items. 

Case 2. Rosemary used the most common erroneous rule to solve fraction 

subtraction problems. She subtracted the smaller from the larger number 

the corresponding parts cf the two fractions: 

\ 4 4/12 - 2 7/12 - 2 3/0 ' 

She Had one correct answer on the test: 

4 3/5-3 4/10 - 1 1/5 

That correct answer results from*' using her eii.oneous rule on this item. 

This rule seems to result from a lack of understanding that the 

denominator of a fraction symbolizes the size parts required by the 

problem as well as from the smaller from larger rule (Brown and Burton, 

1978). This error has been attributed to an "...attempt to commute sub- 
traction problems',' (Res nick, 1983). 

Case 3. Another common erroneous rule which' of ten results in 
correct answers Is the one in which a student subtracts the smaller from 
the larger in the numerators, but keeps corresponding equal denominators ■ 
in the answer. The data shows that Andy used this procedure: 

4 4/12 - 2\7/12 - 2 3/12 - 2 1/4 -and* 

5 3/15 - 3 8^15 - 2 5/15 « 2 1/3 

He also quite likely used the same erroneous rule on the 12 items in 
which the larger' numerator was contained in the first fraction: 

f 

\ 
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3/4 - 2/4 - 1/4 and * 4 S/7 - 4 3,7 - 2/7 
If chose correct items had been scored wrong, assuming that he followed 
Jin Incorrect algorithm, his total score would have been 10 rather than 

the 22 which was recorded. ' • * 

.Of course, it la jjossible that Andy does understand* that fractions 
* represent quantities, he does calculate common denominators, but that he 
has Jus - forgotten the procedure that would put the minuend Into a form 
that would allow subtraction of the subtrahend* We cannot tell from bis 
responses*. 

the Relationship of Method of pfeblem-Solvihg and Score 
Another type of response Is even? more difficult to Interpret. Some 
teachers teach students to convert all mixed fractions to improper 
fractions as the first step In solyftag fraction subtraction problems. 
The ae.thod is often called by name ' "around the world". The student 
begins with the whole number, multiplies by the denominator, and t>en 
adds the numerator. To corivert'?^3/5 he might say, "Begin with three, 
around to" five, three times five equals fifteen, go around to three, 
fifteen plus 3 equals eighteen over five." This procedure sometimes 
results In large numerators and is time consuming, but if the student 
works carefully and then uses the procedure of subtracting the smaller 
cumerator from the larger numerator while keeping common denominators, 1 
^* all items with like denoninators will be correct. This 'method of work 

is called "Method A 1 * by Klein. It is usually possible to tell whether a 
student has used this method from the scratches on his paper and often 
from his first, unsimplif led, response. 

i 

Case 4. Jonathon received the second higest score of. the students 

tested ising Method A: 

4 3/5 - 3 4/10 - 23/5 - 34/10 - 46/10 - 34/10 - 12/10 - 1 1/5, and 
3 3/8 - 2 5/6 -~27/8 - 17/6 - 81/24 - 68/24 - 13/24 

He was able to get all buMnae problem correct, but there is some 

^^^^ \, | 

question about the level of mathematical development that he had 
attained. ^ • 
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In an attempt Co determine whether the select Ion of a particular 
set hod for solving a particular jsroblem c*uld help diagnose student 
erroneous rules; a comparison .uas made between the students' use of 
method A and the students' scores* It was first fait that the selection 
of the most appropriate methbd" for solving each item, perhaps as a 
• response to some "Impasse" (Brown and VanLehn, 1980), might lead to 
higher scores because the choice of Method A does result' in- right 
answers. The data shows that the students in the high scoring third of 
the sample group had 56% of the uses of Method A. 'The middle third had 
Z5Z and the low scoring third had only 17% of the uses of that method. 
The use of method A did seem to be associated with obtaining a high 
score. 

Not only did the hlgest scoring students use aethod A the most 
frequently, but they often selected different items on which to use 
. At this point it seemed as if a correlation of the frequency of the use ' 
q Method A with the number of correct responses for the item might show 
which items we ire most appropriate for the use of method A; however, 
there was no pattern of selection that seemed more appropriate in any of 
the ability groups* The item with the highest correlation was selected 
by the lower ^ roups and the item with the lowest (actually^ sligtly 
negative) correlation was selected frequently by all groups. $ It 
appeared that a student's selection, of Method' A was unrelated to the 
characteristics of the item, such as the % need for 11 borrowing". 
Borrowing as re let fed to Problem- So lying Method 

Fourteen of the test Items were designed to test the ability to 
"borrow"* That ability 'requires the student to change the form of the 
minuend so that the subtrahend can be subtracted. In all but, two of the 
items, the two fractions had the same denominators-, but the numerators 
of the second fractions were larger than the numerators of the first. 
The student should be able to convert as many units as needed from the 
first fraction to the size parts needed for the problem and then perform 
the subtraction. In the problem 4 1/3 - 1 5/3 the student should be S 
able to say, "Five thirds is more than one third, so I can't subtract 
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without borrowing. I aay change one of the units in the four into three 
thirds and add it to tha ona third of the first fraction. That~makes 
three and four thirds and I still cannot subtract five thirds. X must 
change another unit into thirds &hd now I have two and seven thirds* 
Seven minus five equals two; the answer is one and two thirds A 
student who can demonstrate the ability to solve borrowing problems in 
this way has procedural skill as wslX as an understanding of the meaning 
of fractions. However a student may ket correct answers oa those 
problems by correctly using the Method \A procedure and not demonstrate 
borrowing skills or unde r lying % concepts # { 

Case 5. One way to find out whether a student who uses that method 
understands what the fraction means and has choauu that j procedure for 
changing the fraction to allow subtraction might be to find out whether 
the need to Increase the first numeratfoVj^rompts the student to use 
Method A* Celeste used Method A when borrowing was needed i 

7 3/5 - 4/5 - 38/5 - 4/5 - 34/5 - 6> 4/5 
but when the second numerator was smaller she wrote: 

^ 4 5/7 - 1 4/7 - 3 1/7 

She used Method A only* when the form of the first fraction required 
changing* 

Upon examination of the data, it was found that of the 17 * 
stdents who used Method A to solve more than 2/3 of the items requiring 
borrowing » only three of them failed to use Method A on some item not 
requiring borrowing* Ten/of- them used Method A on toore than two thirds 
of the items which, did riot require borrowing* 

Case 6. While Ken used Method A in all the problems requiring 'borrowing 
4 4/12 - 2 7/'2 - '52/12 - 31/12 - 21/12 - 1 9/12 • 1 3/4 
he also used that method in all the mixed fraction problems- that did not 
require borrowing: . 

3 4/5 - 3 2/5^- 19/5 - 17/5 - 2/5 

i * 

Since the use of Method A often does not seem to be dependent upon the 
need for borrowing in the particular item* we do not know from its use 
whether the student recognises tha* need or not* * 
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Case 7. Many of the students who do not use Method £ n*ke 
discriminations which Indicate their awareness of the need for borrowing 
in problems with* the smaller numerator in the first fraction. The most 
common erroneous, rule of that type is illustrated by Juanita. She did not 
convert mixed fractions to improper fractions and has correct answers for 
the items with the larger numerator in the minuend, however when it is 
necessary to Increase the numerator of the first fraction, she reduces the 
whole number by one unit and adds 10 to the numerator of the fraction: 

4 4/12 - 2 7/12 - 3 14/12 - 2 7/12 - 1 7/12 
The use of this rule indicates that the student recognizes the need for 
borrowing but do*".* not understand the concept that a unit must be 
divided into the number of fractional parts as determined by the 
denominator required in the problem. In addition, it indicates 
familiarity with the procedure used for borrowing in subtraction of 
multidlglt whole numbers* The student may only need to extend his 
understanding of numbers as compositions of tens and units (Resnick, 
1983) to the idea that fractional parts may be other than ten. That 
erroneous rule does give the correct answer when the fraction is 
partitioned into ten parts: 

4 1/10 *• 2 8/10 - 3 11/10 - 2 8/JO - 1 3/10 

Several variations of procedural errors were made by students who 
perceived tt*a: borrowing was necessary. 

r ise 8. When borrowing from a whole number or the whole number part o 
fraction, John did not change the whole number even tltough he correctly 
increased the numerator: 

3 3/15 - 3 8/1S - 5 18/15 - 3 8/15 - 2 2/3 

Case 9. Dave added rather than subtracted from the whole number part 
of a mixed number when borrowing: 

4 4/12 - 2 7/12 - 5 16/12 ~ 2 7/12 - 3 3/4 

Case 10. Lisa subtracted from the numerator part of the fraction 
part as well from the whole number part when borrowing frcm a mixed 
number: 

4 4/12 - 2 7/12 - 3 15/12 - 2 7/12 - 1 8/12 
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Errors of this type result In wrong answers but do give information 
that the student has reached the level of understanding at which he 
recognizes that the number of fractional parts in the first fraction 
muse be increased before subtraction is possible. 

Common Denominator Errors 

The practice of keeping or calculating a common denominator may be a 
result of following a rote procedure or having knowledge of the concept 
of needing the same number of parts in each fractional quantity in order 
to add or subtract* Some indication may be obtained by examining the 
student's responses on the items which do not have like denominators. 

Case 11* Paula kept the denominator when they were the same, but selected the 
one closer to the equal sign if they were different: 

5/6 - 1/9 * 4/9 and 4 4/9-3 5/6 - 1/6 
She also consistently omitted the whole number part of the answer. 
There is evidence that she does not understand the meaning of the 
denominator even though she follows the correct procedure of keeping 
common denominators in the answer. 

Case 12* Brian solved the common denominator problem by using the 
denominator of the first fraction in the answer: 

5/3 - 3/4 - 2/3 and 5/3 - 5/6 - 0/3 

Case 13. Michelle used the largest denominator of the two fractions 
as the denominator of the answer: 

5/6 - 1/9 - 4/9 and 3 3/8-2 5/6 - 1 2/8 

Case 14. Sometimes a student seems to recognize the need for the same 
denominator in each fraction but does not recognize the necessity of 
changing the numerator also in order to keep the quantity property of 
equivalence in the fractions. Ben had this problem in several test items: 

5/3 - 3/4 - 2/12 - 1/6 and 4 4/9-3 5/6 - 1 1/18 
Notice that he subtracts smaller from larger in the numerators. 

These solutions show some idea that the denominators should not be added 
or subtracted, but indicate that the student cannot visualize the 
denominators as the result of partitioning of units in each fraction 
into the same size parts. 

t 
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Errors in Combining Procedures 
The use of Method A does not result In a simple solution to problems - 
that involVe calculating a common denominator as well as borrowing* Two 

of the prQblens on the 'test required both of those procedures. If the 

i 

student converts the fraction without regard for the necessity of 
borrowing, which seems to be the most frequent case, after he has 
converted both fractions to Improper fractions, he must then find a 
common denominator and the equivalent fractions* Only three 

then find a common denominator and the equivalent fractions* Only * 
three of the students who used Method A got both of those problems 
correct, , 

Case 16* Oeren had trouble with the calculations involved, making an 
error in equivalent fractions; 

4 4/9-3 5/6 - 72/18 ~ 58/18 - 14/18 - 7/9 
Case 16. Brad subtracted unlike denominators: 
3 3/8 - 2 5/6 - 27/8 - 17/6 - 10/2 - 5 
Case 17* Louis, who usually used Method A, found the common denominator in 
this case and then subtracted the smaller from the larger: 

3 3/8- 2 5/6 - 3 9/24 - 2 20/24 - 1 1/1/24 

Case 18. Chandra inverted the second fraction, cancelled, and then/ 
subtracted corresponding parts when faced with unlike denominators: 

4 4/9-3 5/6 - 40/9 - 6/23 - 40/3 - 2/23 - 38/20 

At least the last three of these errors result from underlying 
misconceptions • Students who do not normally use Method A also made 
errors on those problems* 

Case 19* Jimmy subtracted denominators when the problem required both 
borrowing and calculating a common denominator: 
3 3/8-2 5/6 - 2 11/8 - 2 5/6 - 6/2 - 3 

Case 20* Greg, Craig, John, and Theresa all solved problem 34* this 
way: X 

4 4/9 - 3 5/6 - 2/18 - 1/9 
All of these students had written in the number 17 above the first 
fraction* Upon questioning, all of them said that the 17 came from 
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adding 8 + 9. They apparently had realized that both borrowing and 
calulatlng a common denominator would be required even before they had 
written the common denominator. After multiplying the 4 by 2 (common 
denominator calculation), they had added the fraction to 9/9 (borrowing 
conversion) and had neglected the rest of the calculation. In order 
to know that the borrowing would be needed before doing the common 
denominator calculation, the student must have excellent understanding 
of concepts concerning fractions and also know the procedures involved 
in fraction manipulation. - The application of such complicated processes 
did result in wrong answers. 

r*oblems with Zero and One 
Case 21. Curtis always obtained 1 when ha subtracted a number from itself: 

2/3 - 2/3 - 1 and 6/7 - 4/7 - 2/1 
He also answered 1 when the difference was 1: 

3/4 - 2/4 -1/1 

He occasionally kept a common denominator, but he usually subtracted 
them with the a resulting denominator of 1 in the answer. His procedure 
as well as his understanding of fractions is faulty. 

Some students follow a practice which results in eliminating zero 
from all answers. This could stem originally from counting errors such 
as beginning with the wrong number (or finger) when using the 
decrementation method of subtraction, but with the 13 to 15 year old 
students in the sample it would more likely be a method to cope with the 
fact that answers with zero in the denominator or the numerator look 
unfamiliar or illegal. 

Case 22. Nicole followed the practice of omitting a zero whether it 
occurred in the numerator or the denominator: 

3/4 - 3/8 - 0/4 - 4 and 6/7 - 4/7 - 2/0 - 2 
The only correct answers that occurred on her paper were found on the 
items which subtracted whole numbers from mixed fractions and the ones 
that resulted in zero, items which she apparently solved in her head. 

Case 23. Chris arranged not to have denominators of zero by using a 
cross inversion method: 
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13/9 - 1/9 - 13/1 - 9/9 - 4/8 and 
4 1/10 - 2 8/10 - 4 10/10 - 2 8/1-2 2/9 
This procedure was only used when the numerator was 1. Otherwise he 
usually kept a common denominator. When a numerator was calculated as 
zero, he omitted it and used the. denominator as a whole number: 

3/4 - 3/8 - 4 and 5/3 - 5/6 - 3 
Unusual Erroneous Rules 
Case 24. A curiour result of incorrect application of a procedure Is 
found in the work of Michael. He seems to have a goal of making the 
numerators or the denominators in the fractions apree and then keeping 
that number in the answer: 

5/3 - 3/4 - 5/3 - 4/3 - 1/3 (by inversion) and 
. 5/6 - 1/15 - 1/6 - 1/3 - 1/3 (by cancellation). 
The problem 2/3 L 2/3 is easy for *ilm;- the answer is 2/3. He knows 
^several procedures and has an objec ive, but displays a lack of 
understanding about the meaning of fractions. 

Case 25. Rana had no trouble calculating common denominators or 
converting a whole number to a mixed fraction for the purpose of 
borrowing, but she was confused when she needed to borrow from the whole 
number part of a mixed number. She often added all the digits in the 
mixed number to obtain the numerator of the converted mixed fraction. 
4 1/10 - 3 15/10, 4 1/3-3 8/3, 4 4/12 - 3 20/12 
Case 26. An incorrect procedure which indicates that the student is 
not thtnking of fractions as quantities is the one that Joe uses. He 
cross subtracts for the numerator and denominator of the answer. Usually, 
he arranges the answer so the numerator is smaller than the denominator: 

4 4/12 - 2 7/12 - 2 5/8 and 11/8 - 1/8 - 3/7 
While the same answers would result for problems with like denominators 
if he subtracted within each fraction, he followed the cross subtraction 
rule also for those with unlike denominators: 

5/6 - 1/15 - 5/10 -1/2 and 4 4/9-3 5/£ - 1 2/4 - 1 1/2 
Case 27. Becky used a combination of erroneous rules that Illustrate 
her underlying misconceptions about fractions. In mixed fractions she 
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subtracted the whole numbers for the numerator and added all the fraction 
parts in both fractions for the denominator: 

4 4/12 - 2 7/12 - 2/35 
For simple fractions, she subtracted the numerators for the numerator 
and the denominator was always zero. This treatment of the denominator for 
like denominator problems gave the same answers as the students who 
subtracted corresponding parts, but the zero in the case of fractions which 
had unlike denominators suggests that she used a more general rule. 
Her procedures seem to be erroneous rules for treating a set of 
unrelated digits. 

Sometimes a student's work may indicate more than a lack of 
knowledge or concepts. 

Case 28. Steve's errors rare only 31 percent diagnosed by the 
computer program and many of those matches seemed to be chance occurrences. 
He used different rules for almost every item and some of them were 
unique . 

/ 

For example: / 

5/3 - 3/4 - 16/9 - 1 7/9 
From the scratches. on his paper it was discovered that the 9 was the 
product of 3 x 3 and the 16 was obtained from 5x4-4. 

48/25 - 1 23/25 and 42/28 - 1 14/28 - 1 1/2 
Other examples of Steve's incorrect answers for subtraction of fractions 

we re : 1 

3 1/2 - 2 3/2 - 5 2/1 - 1 1/1 - 6 1/1 / 

4 4/12 - 2 7/12 -28/5-1 3/5 / 
Such response patterns may indicate that the student has poor conceptual 
and procedural knowledge, or that he has some motivational or attitudlnal 
problem. Steve had penciled in the words "Ha Ha" In the space next to 
one of his answers. Onl^interviewlng students of this type can help 
explain such performance. 

While the total score has long been used as the measure of a 
student's knowledge, the cases studied for this report indicate that 
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much more important information can result fro© consideration of 
students wrong answer*. Information about methods of problem-solving and 
possible underlying misconceptions can lead to more accurate evaluation 
and more appropriate remediation* ^ 

The summary list of frequencies observed in various subtraction 
erroneous rules is given below* The rilimber of students who used 
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Rule 2 (subtract the smaller number from the larger* corresponding 

parts) is dominantly large, 558* The second largest number is 

Rule 8: Subtract the smaller from the larger number in unequal 

corresponding parts* but keep equal corresponding parts the same. 

The third-most popular error is a borrowing error: Reduce the 

r 

whole number of the minuend by 1 and add one to the tens column of 
the numerator. The first two errors* are also often observed in 
whole number subtraction and signed number addition and subtraction 
problems. It seems .that the idea of a large number minus a smaller 
number is deeply rooted in many students past knowledge base. 
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Table 8 

Frequencies of Each Subtraction Rule Observed in 
138 Students. 32-Item Fraction Subtraction Test 
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Microcomputer Programs for Error Diagnosis 

of Fraction Subtraction 1 ' „ 

The micro-computer programs were implemented because it was 
felt that computerized assistance for teachers must be available 
on micro-computers in order to be useful at the present time. The 
study included analysis programs, user interfaces including both 
student on-line tests and editors for data entry and modification, and 
printed output designs i to be useful for teachers as well as for 
research. Several pilot studies were carried out with public 
school students and teachers in order to explore the potential 
of the computer. 

The programs were written in UCSD Pascal on the Apple 
computer. Students and teachers from two school districts, Urbana 
Junior High and Sullivan secondary schools tried the programs and 
consulted. The test items used were those designed for error 
analysis of fraction subtraction (Klein, et al. , 1981). 

The student data was stored in records containing the student 
ID, grades in English and math, sex, an attitude index, the whole 
number, numerator, and denominator of two student responses, and 
up to 64 Boolean variables available for each test item for matching 
student responses with erroneous responses. The computer program 
allowed up to 200 records of this structure to be stored on* a data 
disk. Other data files stored over 500 correct and "buggy" student 
responses. 

Por the data files there were editors for data entry and 
merging student records from data collected on different disks. 
File modification and printout programs for examination of the data 
both on screen and hardcopy were implemented. The editors were used by 
teachers and students for recording data and in addition, a test driver 
was used for' collection of data from on-linfe testing. Programs 
calculated the correct answers by decimal value as well as fraction 
forms according to Method A and Method B. 

Other, programs. -identified - g tudentf items, solved by using Method A y 
marked the student record for that characteristic and compared the 
use of Method A with correct answers by student and by item. A 
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program sorted the student responses by item, and recorded the 
frequency of each response, checkiS^ both first and second answer. 
Ar other program compared all student responses vith the classified 
wrong responses and marked the student record for the different 
"bugs" as they occurred in the data. 

Great effort was made to design printed output that would be 
helpful for analysis as well as for teacher assistance. The program 
prints a matrix by student and item with frequer^cies of occurrence. 
The student records were sorted according to total score and the 
items were sorted According to difficulty. A chart, called an 
S~F table, was made of the sorted file* according to student 
score and difllculty of item. The items were marked with 
a ,f + ,f if tha answer was correct, a space if the item was blank, a 
"?" or ff * lf if undiagnosed (depending upon the method used) and with 
a symbol (see descriptions of errors) to Indicate erroneous rules. 
A sample of s^me student records printed according to this program 
is included. For the purpose of analysis, several print programs 
were designed which allowed comparison of student responses over 
subsets of items as well as calculations such as the caution index 
for each student and proportions of different response characteristics. 

Originally, 31 misconceptions were used to diagnose the 139 cases 
in the sample. 23 of them were found to occur in more than one percent 
of the responses, and six of them accounted for 83 percent of the 
diagnosed erroneous rules in fraction subtraction. 81 percent of the 
observed incorrect responses have been diagnosed. Some of the 
underlying misconceptions were comprised of combinations of errors 
and some error patterns still defy description. The computer programs 
roved to be very helpful in selection of case studies for illustration. 

Some testing was done of programs with special purposes. An item 
generator was tested with the objective of comparing generated items 
to those designed for error diagnosis with respect to parallelism. 
The results were promising and proved to be much faster than Expected, 
whi<A allows generation. 

Insert Table 9 about here 
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* Table 9 

m „ S-P Bug Table for Subtraction Problems 
Student Total . * * 

Number Score Item 



0102312303*01 1023 3 3 001 123020 1 22312243413 
6287349795 6-5 784506917130928303429261 1034 
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Bug Descriptions • 

« 

■ 

a (2) Smaller from larger, corresponding parts. 

b (3) Smaller from larger numerator, add denominators* 

c (4) Smaller from larger numerator, use largest denominator* 

d (5) Smaller from larger numerator, use first denominator* 

e (6) Cross subtract. 

g (8) Smaller from larger in unequal parts, keep equal parts* in answer, 
J (11) Smaller from larger numerator, denominator * 0. 
k (12) Subtract whole numbers for numerator, add all fraction parts 
for denominator. 

A (30) Reduce whole number of minuend by 1 and add 1 to the tens 

column of the numerator when borrowing. 
B (31) Borrow but^o not reduce the value of the whole number of the minuend. 
0 (33) Calculate improper fractions by Method A and then drop denominators. 
J (39) Subtract whole numbers and omit fraction parts fxrpm the answer. 
+ Correct answer. 

- Item not used. 

? Undiagnosed, Method B. 

* Undiagnosed, Method A. 

blank No answer 

The numerals and letters are from the list of erroneous rules of operation (bugs) 
given in the Appendix. 
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Such item generation would be desirable in remediation programs. 

if 4 * 

A student input program which would encourage students to "show their 
, work" much as they do on paper and pencil tests was tested. fThe 
purpose was to allow the computer to save their steps in problem- 
solving. The results have not been satisfactory since the student 
interface is too complicated for easy use. Probably some additional 
item type is needed in order to test method of work. 

While it was necessary to begin with actual data in order to 
test the micro-computer capacity, it now appears feasible to 
generate wrong responses and store them which would make the program , 
useful for different items* the search can be done rapidly enough 
to make it reasonable to match errors and record them during 
•on-line testing. This makes adaptive-testing a possibility for 
use with micro-computers and as technology -advances it is almost a 
certainty that it can be done. 



Summary 

A painstaking error analysis and construction of buggy programs 
were carried out and summary Statistics were described in this report. 
The analysis results indicate that individual differences in applying 
different strategies and' procedural skills 'varied more among students 
,than we had expected. Many erroneous rules are committed by students/ 
who used them sporadically.. These rules are often observed only once 
per student alnid never used repeatedly by the*&ame individual. , Various 
error types, i.e., sources' of misconceptions, cover almost all the levels 

< r 

of tasks involved i?i solving fraction problems. 

A" close examination of frequency distributions of erroneous rules 
revealed that some errors tend to appeal among high-spore students \ 

while others appeared only among low-score students. Systematic 

* 

investigation of "bug-behaviors" will lead to further understanding in 

* • ' ' ..... 4 m ^ ( 

human cognition and learning and thus it will bring about further 
improvement in American education. . * 
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